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Abstract 

Let U„(F g ) denote the group of unipotcnt n x n upper triangular matrices over a finite field 
with q elements. We show that the Heisenberg characters of U„ + i(F g ) are indexed by lattice 
paths from the origin to the line x + y = n using the steps (1, 0), (1, 1), (0, 1), (0, 2), which are 
labeled in a certain way by nonzero elements of ¥ q . In particular, we prove for n > 1 that the 
number of Heisenberg characters of U„+i(F g ) is a polynomial in q — 1 with nonncgative integer 
coefficients and degree n, whose leading coefficient is the nth Fibonacci number. Similarly, we 
find that the number of Heisenberg supercharacters of U n (F g ) is a polynomial in q — 1 whose 
coefficients are Delannoy numbers and whose values give a g-analogue for the Pell numbers. By 
counting the fixed points of the action of a certain group of linear characters, we prove that 
the numbers of supercharacters, irreducible supercharacters, Heisenberg supercharacters, and 
Heisenberg characters of the subgroup of U„(F g ) consisting of matrices whose superdiagonal 
entries sum to zero are likewise all polynomials in q — 1 with nonncgative integer coefficients. 

1 Introduction 

Let U n (F 9 ) denote the unitriangular group of n x n upper triangular matrices with ones on the 
diagonal, over a finite field ¥ q with q elements. This is a finite group with q n ( n ~ 1 )/ 2 elements 
and, writing p for the prime characteristic of ¥ q , a Sylow p-subgroup of the general linear group 
GL„(F g ). Classifying the irreducible representations of XJ n (W q ) is a well-known wild problem (cf. 
the discussion in Section 2 of (TJ). When n < 2p, there is at least a method of constructing the 
irreducible representations from certain coadjoint orbits (see |25j). but even in this situation we 
have no way of enumerating the orbits in any accessible fashion. 

Despite this, the representation theory of U n (F g ) engenders a surprising abundance of combina- 
torial structures-provided we refocus our attention on irreducible representations to other families. 
A prominent success story of this philosophy comes from the theory of supercharacters introduced 
by Andre [2j [3] , simplified by Yan [30] , and generalized by Diaconis and Isaacs [5j . A brief overview 
of this subject goes as follows. 

Let n denote a nilpotent finite-dimensional associative F 9 -algebra, and write G for the corre- 
sponding algebra group of formal sums 1 + X for X E n. For example, one could take n to be the set 
u n (¥ q ) of n x n strictly upper triangular matrices over ¥ q so that G = U n (F 9 ). Choose a nontrivial 
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homomorphism 9 : F+ — > C x . The elements of the dual space n* of F^-linear maps n — > ¥ q then 
index a basis for the group algebra CG, given by the elements 

vx ■= J2 e ° X (9- 1)9 e CG, for A en*. 

The supercharacters of G are defined as the characters of the left G-modules CGv\ for A € n*. 
These characters are often reducible, but their irreducible constituents partition the set of all 
complex irreducible characters of the group G. In view of this and other nice properties, the set 
of supercharacters serves as a useful approximation to Irr(G). In particular, the supercharacters 
of an algebra group form an important nontrivial example of what Diaconis and Isaacs call a 
supercharacter theory of a finite group [9]. 

In contrast to the irreducible characters, the supercharacters of the untriangular group may 
be completely classified; viz., by a g-analogue of the set partitions of [n] := {i € % : 1 < i < n}. 
Write A h [n] and say that A is a partition of [n] if A is a set partition the union of whose blocks 
is [n]. A pair € [n] x [n] is an arc of A h [n] if i and j occur in the same block of A such 
that j is the least element of the block greater than i. Let Arc(A) denote the set of arcs of A, so 
that for example A = {{1,3}, {2, 4, 6, 7}, {5}} h [7] has Arc (A) = {(1, 3), (2, 4), (4, 6), (6, 7)}. A set 
partition A h [n] is then noncrossing if no two arcs (i, k), € Arc(A) have i < j < k < I. The 
g-analogue indexing the supercharacters of TJ n (¥ q ) is now defined thus: 

Definition 1.1. An ¥ q -labeled partition of [n] is a set partition A h [n] with a map Arc(A) — > F* . 
We denote the image of € Arc(A) under this map by Ajj. 

Let II(n, F q ) and NC(n, ¥ q ) denote the sets of ordinary and noncrossing F 9 -labeled set partitions 
of [n]. We may view II(n,F 9 ) as a subset of u n (¥ q )* by defining 

A(X) := A ij x ij, for A G n(n,F 9 ) and X G u n (F 9 ). (1.1) 

(iJ)€Arc(A) 

Here Xij denotes the entry located in the i th row and j th column of the matrix X. Write xa f° r the 
supercharacter of XJ n (¥ q ) corresponding to the module generated by v\ G CU n (F g ). The following 
remarkable result derives from the work of Andre [21 [3] and Yan [30] : the correspondence A 1— > xa 
is a bijection 

II(n, F 9 ) — > {Supercharacters of XJ n (¥ q )}, ^ 
NC(n,F 9 ) — > {Irreducible supercharacters of U n (F 9 )}. 

Hence the number of supercharacters of U n (F2) is the nth Bell number and the number of irreducible 
supercharacters is the nth Catalan number. In addition, there is a useful closed form formula 
describing the values of xa in terms of the partition A; see [281 Eq. 2.1]. 

Seeking to emulate this combinatorial classification, in this work we study the Heisenberg char- 
acters of ~U n (F q ). Recall, for example from [5j Appendix B], that a character x of a group G is 
Heisenberg if x is irreducible and ker x 3 [G, [G, G]]. Of course, one naturally identifies the Heisen- 
berg characters of G with the irreducible characters of the quotient G/[G, [G, G]]. The Heisenberg 
characters of XJ n (¥ q ) and related groups take the role usually played by linear characters in sev- 
eral inductive constructions introduced in [5], which provides some motivation for examining such 
objects. We also consider characters of JJ n (¥ q ) which are invariant under multiplication by the 
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subgroup of linear characters C := o a : •& G Horn (F^, C x ) }, where a : U n (F 9 ) — > F ? is the 
homomorphism which assigns to g the sum of its entries on the first superdiagonal: 

o-(s) : = 5i,2 + 52,3 H h ff n -l,n. for 9 G U n (F 9 ). 

Our investigation of C-invariant characters will allow us to count various families of characters of 
the interesting subgroup U^(F g ) := {g £ U n (F g ) : cr(g) = 0}, whose supercharacters are described 
in [19\ Example 5.1]. 

Our main result is a classification of the Heisenberg characters of U n (F g ) in terms of certain 
labeled lattice paths. Fix a subset S C N 2 , where N = {0, 1, 2, . . . } is the set of nonnegative integers. 
Formally, a lattice path with steps in S shall refer to a finite sequence P = (s±, S2, ■ ■ ■ , Sfc) of elements 
of S. The sequence P represents the path which begins at (0, 0) and travels to s\ + S2 + • • • + st € N 2 
at time t £ [k], ending at the point (a,b) = s\ + S2 + • • • + s^. The most obvious way of labeling 
a lattice path would be to assign labels to each step, but instead we require the following slightly 
more subtle definition. 

Definition 1.2. An ¥ q -labeled lattice path is a lattice path with a rule assigning to each step 

in the path a sequence of labels (xi, . . . , Xj) £ (F x ) J . Thus, the number of nonzero labels assigned 

to a step is the step's height, and we consider steps of the form (i, 0) to be unlabeled. 

For each integer n, let Jif(n,Wq,S) be the set of F^-labeled lattice paths with steps in S C N 2 
which end on the line {(x, y) : x + y = n — 1}. As special cases, we define 

J^Peii(n, F,) := Jgf (n, F„ S) where S = {(1, 0), (1, 1), (0, 1)}, 

^Heis(n,F g ) := if (n, ¥ q , S') where S' = {(1,0), (1, 1), (0, 1), (0, 2)}, 

~2k v (n,F 3 ) := jSf (n,F„ 5") where 5" = {(2, 1), (1, 2), (0, 1)}. 

We also define two modified families of labeled lattice paths 

-^Heis( n ; Fg) := |Paths in JzfHcis( n 5 F 9 ) which do not begin with the step (0,2)|, 

-Sflnv(^ 5 F g ) := |Nonempty paths in «S?i nv (n,F g ) U^fi nv (n — 1,F 9 ) beginning with (0, 1) j. 

The relevance of these definitions derives from the following result, which we prove as Theorems 
BUEl and O below: 

Theorem 1.1. For each integer n > 1 there are bijections 

(1) Jz?p c n(n, Fq) o {Heisenberg supercharacters of U n (F g )}; 

(2) JzfHds(^ ; Fg) o {Heisenberg characters of U n (F g )}; 

(3) «Sfi nv (n,F 9 ) o {C-invariant Heisenberg characters of U n+ i(F g )}. 

Our proof of this theorem derives essentially from the method of decomposing the superchar- 
acters of an algebra group described in [20] . We compute from these correspondences explicit 
polynomial formulas for the numbers of Heisenberg supercharacters, Heisenberg characters, and 
C-invariant Heisenberg characters of the unitriangular group. Notably, the number of Heisenberg 
supercharacters of U n (F g ) is a polynomial in q — 1 whose coefficients are Delannoy numbers and 
whose value at q = 2 is the nth Pell number. Concerning the Heisenberg characters of U n (F 9 ), we 
have the following theorem: 
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Theorem 1.2. For integers n > 1 and e > 0, the number of Heisenberg characters of U n +i(F 9 ) 
with degree q e is 

^ i (( B r e ) to " i),+ ("~«~ 1 ) (, " i) * H )- 

Hence the number of all Heisenberg characters of U n +i(F 9 ) is a polynomial in g— 1 with nonnegative 
integer coefficients and degree n, whose leading coefficient is the nth Fibonacci number. 

Finally, using Clifford theory with these classifications, we are able to produce formulas proving 
following result, given below as Theorem 16.11 

Theorem 1.3. The numbers of supercharacters, irreducible supercharacters, Heisenberg super- 
characters, and Heisenberg characters of the subgroup U£(F 9 ) C U n (F g ) are polynomials in q — 1 
with nonnegative integer coefficients. 

We organize this article as follows. In Section [2] we discuss in slightly greater depth the super- 
characters of an algebra group, showing in particular how our brief definition above coincides with 
the standard notions developed in [2J [3l 13 [30]. We then review the method of decomposing super- 
characters into constituents described in [20], and prove in Section [3] that such constituents exhaust 
all Heisenberg characters of TJ n (F q ). In Sections U] and [5] we classify the Heisenberg characters of 
U re (F g ), in particular proving Theorems 11.11 and 11.21 Finally, in Section [HJ we count the super- 
characters, irreducible supercharacters, Heisenberg supercharacters, and Heisenberg characters of 
U^(F„) in order to prove Theorem 11.31 

2 Preliminaries 

Here we review some of the properties of the supercharacters mentioned in the introduction. 
2.1 Supercharacters of algebra groups 

Our reference for the following statements is [9]. As in the introduction, let n be a nilpotent ¥ q - 
algebra which is associative and finite-dimensional, and write G = 1 + n for the corresponding 
algebra group of formal sums 1 + X with X G n. Recall that 6 : F+ — s> C x is a fixed nontrivial 
homomorphism. 

The distinct irreducible characters of the additive group of n are the functions 6 o \ with A 
ranging over all elements of the dual space n*. Hence, if we define 9\ : G — > C x for A G n* by 

0\(1 + X):=9o \(X) for X G n 

then the maps {9\ : A G n*} form an orthonormal basis with respect to the usual L 2 -inner product 
(-, •) of the vector space of functions G — > C. Observe that in the notation of the introduction we 
have v x = J2 g eG°^9)g € CG. 

Definition 2.1. Given A G n*, denote by xa the complex conjugate of the character of the left 
G- module CGv\ = C-span{gv\ : g G G}. 

Remark. Since \\ is the character of the module <£Gv-\, each x\ 1S a supercharacter according 
to the definition in the introduction and the set of supercharacters of G is precisely {x\ : A G n*}. 
The complex conjugation in this definition is a notational convention meant to accommodate the 
formula (|2.ip below. 
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The group G acts on the left and right on n* by (g, A) i— > gX and (A, g) i— > Ag where we define 

#Apf) = A(5 _1 X) and Ag(X) = ApfcT 1 ), for A G n*, g G G, len. 

These actions commute, in the sense that (gX)h = g(Xh) for g,h £ G, so there is no ambiguity 
in removing all parentheses and writing expressions like gXh. We denote the left, right, and two- 
sided orbits of A G n* by GX, AG, and GAG; then GA and AG have the same cardinality and 
|GAG| = j^xrugj ^ Lemmas 3.1 and 4.2]. A simple calculation shows gv\ G C-span{n 9A } and 
v\g G C-span{?; A9 } for g G G. It follows that CGv\ = CGv^ if /i G GAG and that CG is the direct 
sum of the distinct two-sided ideals CGv\CG = C-spanjt^ : fi G GAG}. Consequently, xx = X/j, if 
^, G GAG and (xx,X[i) = if /i ^ GAG. This means that the number of supercharacters of G is 
the number of two-sided G-orbits in n*, and that each irreducible character of G is a constituent 
of exactly one supercharacter. 

Since j^j- X^Aen* ^A = 1, the element ^ X^eGAG v ^ ^ s a central idempotent for CGv\CG. By an 
elementary result in character theory (e.g., |16l Proposition 14.10]), the coefficient of g G G in this 
idempotent is the complex conjugate of the value of the character of CGv\CG at g. This character 
is just x\ times |GAG|/|GA|, the number of left G-orbits in GAG, and so 

IGAl 

1 1 fieGXG 

GAI 2 

The orthogonality of the functions implies that (xx,Xx) = jgagT = 1^ ^ Thus, xx 

is irreducible if and only if GA PI AG = {A}. As t^t Xa is the character of the two-sided ideal 
CGv\CG, an irreducible constituent ip of xx appears with multiplicity ^^ -^(l). 

2.2 Decomposing supercharacters 

In practice, one can often decompose the set of supercharacters of an algebra group into a larger 
family of orthogonal characters by adopting a slightly more intricate construction. This ability will 
prove useful in classifying the Heisenberg characters of U n (Fg), so we briefly describe it here. 

Proofs of the following statements appear in [20] . For each A G n*, define two sequences of 
subspaces t A , s A C n for i > by the inductive formulas 

(a = {0}, aM l A +1 = {X G s\ : X(XY) = for all Y G 4} , 
5° x = n, s A +1 = {X G 4 : X(XY) = for all Y G t A +1 } . 

One can show that xa(1) = |GA| = |n|/|[ A | and (xx,Xx) = |GA n AG| = |s A |/|( A |. In addition, the 
subspaces l\, s\ are all subalgebras of n satisfying the following chain of inclusions: 

o = r A cr A cric---c4c SA c s A = n. 

These chains eventually stabilize since our algebras are finite-dimensional; we therefore let l\ = R, 
and s A = Hi 5 ! ana ^ define L\ = 1 + l\ and S\ = 1 + s A as the corresponding algebra subgroups of 
G. The function 6\ : g 1— > o X(g — 1) restricts to a linear character of L\ and we define £ A as the 
corresponding induced character of G: 

£ A = lndf (6 X ). 



5 



This character is a possibly reducible constituent of the supercharacter x\\ these are its key prop- 
erties: 

(i) Each supercharacter xx f° r A € n* is a linear combination of the characters {£„ : fi G GAG} 
with positive integer coefficients. 

(ii) Either £ A = ^ or = for each G n*. 

(iii) We have = \S\\/\L\\, and so £\ is irreducible if and only if L\ = S\. When £\ is 
irreducible, it has the formula 

£,\ = -iL= E 6 » where A ° := {9 X 9~ l -9&G}. (2.2) 

The set A G is the coadjoint orbit of A. The right hand side of this formula is a well-defined 
function G — > C (though not necessarily a character) for all A G n*; functions on algebra 
groups with this form are typically called Kirillov functions. 



3 Constructions and lemmas 

In this section we prove that the characters {£a} introduced in Section [2.21 include all Heisenberg 
characters of U n (F g ). Our results will put us in good standing to enumerate the Heisenberg 
characters of U n (F 9 ) in Section [U 

Our first lemma applies to all algebra groups. 

Lemma 3.1. Fix a nilpotent F g -algebra n which is finite-dimensional and associative, let G = 1 + n 
be the corresponding algebra group, and choose A G n* such that ker A D n 3 . If S\ = L\, then 
the supercharacter xx is equal to |s a |/|sa| times a sum of yfrjp^ distinct irreducible characters of 
degree |n|/|s>|. The set of these irreducible constituents is given by {£ M : \i G GAG}. 

Proof. Let \i G GAG. If X G n 2 then gXh - X G n 3 for all g,h G G. Since ker A D n 3 , it follows 
that X(XY) = fi(XY) for all I,F £ n, and from this it is clear that S\ = and L\ = L^. 
Assuming S\ = L\, it follows by property (i) in Section [2T21 that every irreducible constituent of x\ 
is a character ^ for some fx G GAG, and in particular, these constituents all have degree |G|/|La|. 
From the discussion at the end of Section 12.11 it follows that these irreducible constituents each 

appear in x\ with multiplicity j^y^j = ]tT[|f^j = I s aI/I^a|- Dividing xa(1) = \G\/\\\\ by the 

product of this multiplicity with = \G\/\L\\ = |G|/|sa|, we find the xx must have rkrrT < 

\ l \\\ s \\ 

distinct irreducible constituents. □ 

In the following lemma we use the term pattern algebra to mean a subalgebra of u n (¥ q ) for some 
n and q spanned by a subset of the elementary matrices {eij : 1 < i < j < n}. Likewise, a pattern 
group shall mean an algebra group corresponding to a pattern algebra. Equivalently, a pattern 
group is the group of unipotent elements of the incidence algebra of a finite poset over a finite 
field. Pattern groups form a highly accessible family of algebra groups and serve as fundamental 
examples in supercharacter theory; for background and discussion, see jlOJ. Our second lemma 
is a straightforward observation concerning the lower central series and Heisenberg characters of 
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pattern groups. Here we employ the notation [g,h] = ghg~ l h~ l for g, h G G, and for subsets 
5, T C G write [S, T] to denote the group generated by the commutators [g, h] for g G S and h G T. 
Also, Mat n (F) denotes the set of n x n matrices over a field F. 

Lemma 3.2. Let n be a pattern algebra with G = 1 + n the corresponding pattern group. 

(i) Let Gi = G for % > 1 and set G i+1 = [G i} G]. Then d = 1 + n\ 

(ii) If n = u n (¥ q ) and /c is a positive integer, then n fc = {X <G Mat n (F g ) : Xij = if j < i + k}. 

(hi) A character ip G Irr(G) is Heisenberg if and only if ker ip D 1 + n 3 , which occurs if and only 
if -0 is a constituent of a supercharacter xx indexed by a functional A G n* with ker A D n 3 . 

Isaacs proves the special case [G, G] = 1 + n 2 of the first part as [T5J Corollary 2.2]. 

Proof. The inclusion [1 + n l , G] C 1 + n* +1 holds for all algebra groups G and is straightforward to 
check. For the reverse direction, embed n C u n (¥ q ) and suppose the elementary matrix ejg G n* . 
Because pattern algebras are spanned by elementary matrices, there must exist k with G n and 
eui ^ Ti*- Necessarily j < k < t and we have 1 + teje = [1 + ejk, 1 + te^} £ [G, Gi] for all t £ F q . 
Elements of the form 1 + tejg generate the pattern group 1 + n J+1 (see the discussion in Section 3.2 
of [IQ]), so our inclusion in an equality. 

Part (ii) is a simple calculation, and the first statement in (hi) is immediate from (i). The claim 
that V ^ Irr(G) has ker ip D 1 + n 3 if and only if tp is a constituent of a supercharacter xx with 
ker A D n 3 follows from |19} Proposition 3.3] and standard results in character theory concerning 
inflation. □ 

We now have our promised result. 

Proposition 3.1. Each Heisenberg character of TJ n (F q ) is equal to £\ for some A G u n (¥ q )* . 

Proof. Each Heisenberg character is a constituent of a supercharacter x\ f° r some A G u n (F g )* 
with ker A D (u n (F g )) 3 . By (|1.2|) . there exists ^ in the two-sided U n (F g )-orbit of A which is "quasi- 
monomial" in the sense |21^ Section 3.1] and which consequently has = by |21| Theorem 
3.1]. By Lemma [3TT1 the irreducible constituents of xx = are therefore the characters £ v for the 
maps v in the two-sided U n (F„)-orbit of A. □ 

In preparation for Sections [4] and EJ we now prove two somewhat more technical results. Recall 
that if n is a nilpotent F g -algebra and G = 1 + n, then the coadjoint orbit of A G n* is the set of 
functionals {gAg -1 : g G G}. We write e*j G u n (F g )* for the linear functional with e*j(X) = Xij for 
1 < i < j < n. 

Lemma 3.3. Choose integers j, k with 1 < j < k < n - 2, and let X t = *£i =j Ue*^ G u n (¥ q )* for 
some t = (tj, . . . ,tfc) G (F* Assume k — j is odd and let d = (k — j + l)/2. The following 

statements then hold: 

(1) The coadjoint orbit of At is the set 




where a\ , Q2 , ■ ■ ■ , «d G F* 



are elements determined by t. 
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(2) The coadjoint orbits of At + ue* J+1 for u G ¥ q are pairwise disjoint. 



(3) Let 7 = e* sj+1 + e* +1 J+2 + 



+ s*k k+i + e fc+i fc+2 e u n(^g)*- Then the cardinality of the set 



is 



H(<?-i) 



2<l 



i G (F* ) 2d : At + 7 belongs to the coadjoint orbit of At j 



Proof. Direct calculation shows that every element of the coadjoint orbit of At has the form At + k 
for some k G F g -span{e* i+1 : j < i < k + 1}, and that, since every such k is invariant under the 
two-sided action of U n (F g ), one has g~ 1 \tg = At + ft for g G XJ n (F q ) if and only if g~ l \t — \tg~ l = K. 
As an abbreviation, define g\ = g^i+i- Then the map g \— > g Xt — Af<7 _1 is a linear function of the 
entries gj, g j+1 , . . . , g k , g k+1 ; in particular, we compute 5 _1 At - Af^" 1 



Yli=o u » e -*-j-- .--L.--L1 where 



\ 



3+1 



-tk-1 











9j+i 



9k 



Ul 



\ 



U2d-l 
V U2d 



(3.1) 



Define linear polynomials Pt,i{x) = Pt,i(x\, 
P t} i(x) = xi and P t}i+ i(x) 



. , Xd) for 1 < i < d by the recurrence 

X i+ i + (tfc-2i+lAfc-2i+2)-fi(») for 1 < z < d, 



and set Pt(x) = — (tj/tj+i)Pt t d(x)- It is a straightforward exercise to show by induction that the 
linear system (|3.ip has a solution g G U n (F g ) if and only if no = Pt{u2d> u 2d-2, ■ ■ ■ > ^2)> an d this 
suffices to confirm our description of the coadjoint orbit of At- 

If k, k' G F 9 -span{e^ then At + k and At + k' belong to the same coadjoint orbit if and only 
if At and At + (k — k') belong to the same coadjoint orbit. Our claim in (2) follows immediately. For 
the second part, let fd(q) denote the cardinality of the set in (3) and note that At + 7 belongs to 
the coadjoint orbit of At if and only if Pf(l, . . . , 1) = 1. It follows immediately that fi(q) = q — 1. 
Observe that if f = (t j+2 ,t j+3 , ... ,t k ) G (F* ) 2d-2 then P t (l, . . . , 1) = (tj/t j+1 )(P t/ (l, . . . , 1) - 1). 
Consequently if t' is fixed, then the number of choices for the pair (tj,tj+i) G (F*) 2 such that 
At + 7 belongs to the coadjoint orbit of At is q — 1 if Pf(l, ■ ■ ■ , 1) 7^ 1 and otherwise. Hence 
fd{q) = (q — 1) ((<? — 1) M ~ 2 — fd-i{q)) for d > 1 and fi(q) = q — 1, from which we deduce that 
fd(q) is equal to the given expression. □ 

Almost corollary, we have this second lemma. 

Lemma 3.4. Choose integers 7, k with l<j<k<n-2, and let A = J2i=j ^ e *,i+2 € Un(F 9 )* for 
some t 



■j , . . . , 



4sFj. The following properties then hold: 



(1) If k — j is even then the coadjoint orbit of A is A + F g -span|e, 
and £a is the unique irreducible constituent of x\- 



:0<i<k 



i + i} 



(2) If k — j is odd then \x has exactly q irreducible constituents, given by the characters £a+k 
for k G Fq-span{e* J+1 }. 
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Proof. It is a straightforward if tedious exercise to show that 

h = {X 6 u n (F g ) : Xjj + i = Xj + ij +2 = ■ ■ ■ = X k<k+ i = 0} , 
s\ = {X G Un(¥ q ) : X kjk+1 = 0} , 

and 

- _ ^ _ f {X G u n (F 9 ) : = X i+2j +3 = • • • = AT fejfe+1 = 0} , if fe - j is even; 

\{X G u n (F g ) : Xj + ij +2 = ^j+3,j+4 = • • • = X kyk+ i = 0} , if k - j is odd. 

From this, it follows by Lemma 13. II that x\ has a unique irreducible constituent (necessarily given 
by £a) if k — j is even and exactly q irreducible constituents if k — j is odd. In the even case, the 
irreducible characters £^ for \i in the two-sided orbit of A are all equal, so from the formula (|2.2p 
we deduce that the coadjoint orbit and two-sided orbit of A coincide. Checking that the two-sided 
orbit is A + F g -span |e* +J - : < i < k — j + lj is an exercise in linear algebra, similar to but 

much more straightforward than the proof of our previous lemma. 

Assume k — j is odd. Then the q characters £a+k f° r K £ F g -span{e* are all irreducible 
constituents of xx since A + k lies in the right U n (F,j)-orbit of A, so it suffices to show that these 
characters are distinct. Noting the formula (|2.2p above and the fact that the functions {0^} are 
linearly independent, we deduce that the irreducible characters £a+k are distinct if and only if the 
coadjoint orbits of A + k are pairwise disjoint, which was shown in the previous lemma. □ 



4 Heisenberg characters and lattice paths 

In this section we use the preceding results to derive a bijection between the set of Heisenberg 
characters of U n (F g ) and the set of F^-labeled lattice paths ^fnds(n,¥ q ). Leading to this, we first 
establish a few properties of the polynomials counting the five families of F^-labeled lattice paths 
defined in the introduction. 

Let D(a,b), D'(a,b), and D"(a,b) denote the respective numbers of (unlabeled) lattice paths 
ending at (a, b) G Z, 2 with steps in the sets 

S = {(1,0), (1,1), (0,1)}, S' = {(1,0), (1,1), (0,1), (0,2)}, and S" = {(2, 1), (1, 2), (0, 1)}. 

The integers D(a,b) are the well-known Delannoy numbers by definition. By construction, the 
polynomials 





n 






k=0 




%n+l{x) 


n 

■■=E D '( n 


- k, k)x k 




k=0 




In+l(x) : 








fc=0 





give the respective cardinalities of Jz?p e n(ra + 1,F 9 ), ^fnois(n + 1,F 9 ), and J2fi nv (re + l,F g ), when 
n > and x = q — 1. We set V- n {x) = Ti_ n (x) = X_ n (x) = for n > so that this relationship 
holds for all integers n, and note the ordinary generating functions 
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Y J ^-n{x)z n = T -———— — — 

n>0 V ' V ' 



n>0 



1 — xz — x(x + l)z 3 



The first of these suffices to show that {"P n (l)}^L = (0, 1, 2, 5, 12, 29, 70, ... ) is the sequence of 
Pell numbers \26\ A000129], which explains our notation. 

The following proposition gives more explicit formulas for these polynomials. 

Proposition 4.1. For integers a,b,n > 0, the following identities hold: 



[n/2] 



(i) v n+l (x) = ]T 

k=0 

[n/2 



(2) H 



k=0 

[n/3} 



: )x k (l + x) n 

k 

n — k 



k 

(3) l n+1 (x) = £ ( n - k 2k y-*(l + xf and D»(a, b) = £ (° + 6 ~ 2 *) ( * V 

Proof. Supposing x = g — 1, it is a routine exercise to show that the kth term in each of the three 
sums gives the number of F^-labeled lattice paths ending on the line x + y = re with k steps in R 
and the rest of its steps in T, where 



x 



and D(a, b) = 

fc>0 

: {l + x) n - k and D\a,b) = 



a + b — k\ ( a + b — 2k 



k>0 



k 



k 



k 



a + b — k J \a 



R 



'{(1,1)}, in part (1), 

{(1,1), (0,2)}, in part (2), 
^{(2,1), (1,2)}, in part (3), 



and 



T 



[ {(1,0), (0,1)}, in part (1), 
{(1,0), (0,1)}, in part (2), 
[{(0,1)}, in part (3). 



This observation is enough to establish our formulas for V n +i{x), H n +i(x), andX n+ i(x). Extracting 
the coefficients of x k in these sums gives our formulas for D(a,b), D'(a,b), and D"(a,b). □ 



For each integer re, we additionally define 

Hn{x) := H n (x) - X 2 7i n -2(x) 



and 



X n {x) := xl n -i(x) + x2" n _ 2 (x), 



so that \£k cis (n,F q )\ = U n (q - 1) and \S^ nv {n,¥ q )\ = l n (q - 1). Then Hi(x) = 1 and Zi(x) = 0, 
and the preceding proposition with the standard recurrence for the binomial coefficients implies 
the following formulas for n > 2. 

Corollary 4.1. For each integer n > 1, the following identities hold: 



[n/2] 

(i) n n+1 (x) = 

k=0 



n — k 
k 



+ 



n 



x x h (l + x) 



n— fe— 1 
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L(n ^ 1)/3J "n - 2* - 2\ (n - 2k - 1 



fc=0 



Thus / H n (x) and X n (x) both have nonnegative integer coefficients. The preceding results show 
that the leading coefficient of H n +i(x) and T-L n +2{x) is ^ fc ("it* 1 ); a well-known formula for the 
(n + l)th Fibonacci number. We note this briefly as a second corollary. 

Corollary 4.2. Let {/ n }^Lo = (0> 1> 1' 2, 3, 5, 8, ... ) denote the Fibonacci numbers. Then f n is the 
leading coefficient of ~H n (x) and H n +i(x) for n > 1. 

Remark. The second-to-leading coefficients of these polynomials, counting lattice paths ending 
on the line x = 1, are more obscure but have also appeared in other places. For example, the 
coefficients {D'(l, n)}£° =0 = (1,3,7,15,30,58,109,...) of x n in n n+2 (x) form the sequence (2H 
A023610] given by convolving the Fibonacci numbers with a shifted version of themselves. On 
the other hand, the coefficients {D'(l, n) - D'(l, n - 2)}£° =0 = (1, 3, 6, 12, 23, 43, 79, . . . ) of x n in 
T~L n+ 2(x) provide a sequence [26l A055244] counting certain stackings of n squares on a double 
staircase. Turban calls such configurations "lattice animals" and studies their enumeration in |29j. 
It is a reasonably straightforward exercise to show using |29l Eq. (3.9)] that the numbers which 
Turban labels G k have G k+1 = D'(l, k) - D'(l, k - 2) for k > 0. 

To establish the promised correspondence between elements of JzfHeis(ra, ¥ q ) and Heisenberg 
characters of U n (F g ), we use the symbols — >, t, tt to denote the steps (1, 0), (1, 1), (0, 1), (0, 2) 
and we indicate labels with subscripts. Thus, we may list the paths in Jz?Heis(4, F g ) ending at (0, 3) 
as (fx, y Az), (ts)1ty,z), (txAyAz) where x,y,z G F* are arbitrary; note that the path (tx,y,W is 
excluded from ^Heis(4, ¥ q ). 

Define a map J£ft e i s (n, ¥ q ) — >• u n (¥ q )* in the following way. Fix a labeled path 

P = (si,s 2 , ...,st)e J? H eis(n,F 9 ). 

Let dk(P) be the sum of the coordinates of the starting point of the kth step of P, so that this 
starting point lies on the line x + y = d k (P). Now, define Xp t k G u n (¥ q )* for k = 1, ... ,£ by 



A 



Rfe 



0, if s fc = ->■; 

te* i+1 , if Sfc = tt for some i G F* , where i = d k {P) + 1; 

£e* i+2 , if Sfc = for some tGF x , where i = d k {P) + 1; 

ie*_ li+1 + ue* i+2 , if s k = tTt, u for some t, u G F*, where i = d fe (P) + 1. 

Finally let Ap G u n (F q )* be the sum Ap = Api + Ap 5 2 + • • • + Ap^. As an example, if 

P = (->•, /* a ,tb, fc,d) tnen = ae 2,4 + be l,5 + ce 4,6 + de *5,T 

Recall the definition of the characters £a in Section I2.2[ and write £p for the character indexed by 
Ap G u n (F g )* for P G Jz?Heis(^,F,j). We now assert the following. 

Theorem 4.1. The map 

=^kcis("<j Fq) — > {Heisenberg characters of U n (Fg)} 
P £ P 

is a bijection, and the number of Heisenberg characters of U n (F 9 ) is H n (q — !)• 



11 



Remark. The sequence 1 n n (l) \ = (1, 2, 5, 14, 38, 104, 284, . . . ) counting the Heisenberg char- 

I > n=l 

acters of U n (F2) also counts the number of compositions of n — 1 whose odd parts are labeled in 
one of two different ways [26, A052945]. 

Before proceeding, we must introduce a few technical definitions. First, define the upper form 
of a matrix X G u n {¥ q ) to be the (n — l)-by-(n — 1) matrix given by deleting the first column 
and last row of X. The upper form uniquely determines X G u. n {¥ q ) because the row and column 
deleted contain all zeros. Next, define the matrix of a functional A G u n (F g )* to be the matrix 
X = Yli<i<j<n ^i e ij) e iji this is the unique matrix X G u n (¥ q ) for which X(Y) = tr(X T Y). 

We now define the block decomposition of A € u n (F g )* as the maximal sequence of square 
matrices (B±, . . . , Bg) such that the upper form of the matrix of A is diag(l?i, . . . , Bg). As an 
example, the block decomposition of A = is (B±, . . . , B n _i) where each B{ is the 1-by-l zero 
matrix, and if r, s, t,u,v G F* then the block decomposition of 



/ 



re 



1.3 



+ sel 5 4- te\ 6 + ue\ 7 + ve 



7,8 



\ 






s t 
u 

v 



€ u 8 (¥ q )* (4.1) 



is (Bi , i?2 , -B3 , -B4 ) where 



r 




Bo 



0), 



B, 




#1 



(v) 



Proof of Theorem \4-l\ Let X be the set of functionals A € u n (F,j)* such that each matrix in the 
block decomposition of A is of one of the following types: 

(a) X is 1-by-l. 

(b) X is m-by-m for some m > 1 and Xij 7^ if and only if j = i + 1. 

(c) X is m-by-m for some m > 1 with n odd and X^ 7^ if and only if j = i + 1 or i = j = 1. 

As the first step of our proof, we show that P i— ^ Ap defines a bijection ^n e [ s (n,¥ q ) — > ^f. It is 
tedious but not difficult to check that Ap G X for all P G ^ucis(n, ¥ q ). We proceed by constructing 
an inverse map X — > ^n c i s (n,¥ q ). To this end, associate to each A G X the F g -labeled lattice path 
P\ defined by the following algorithm: 

(1) Suppose X £ X has block decomposition (Bi,B2, ■ ■ ■ , Bg). 

(2) Begin with P\ equal to the empty sequence, and for B = B\, B2, ■ ■ ■ , Bg do the following: 



If B is of type (a), append to P\ the step 



if B = 0; 
Tb, if B ^0. 
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• If B is m x m and of type (b), with tj = 5^+1, append to P\ the sequence of steps 

(->•, 1fti,t 2) 1fts,t«, ■ ■ ■ , 1tt m _ 2) t m -i) , if m is odd; 
{Ai, tt 2 ,t 3 , fu,ts, 1t*m-2,*m-i) > if is even. 

In particular, if m = 2 then append the single step /\ ■ 

• If B is m x m and of type (c), with ti = -Bj^+i and u = JB^i, append to P\ the sequence 
of steps (t«, ft u ta, ft 3 ,U, ■■■> ttim-a,*m-i)- 

For example, with n = 8, the functional A = rej 3 + se| 5 + te\ 6 + ueg 7 + ue^ 8 G Af from (|4.1|) 
corresponds to 

(A>-».t*.ttt,u>ti;) € =5f H ei S (n,Fg), 

assuming r,s,t,u,v G F* . If at the beginning of an iteration of (2), the current endpoint of the 
path P\ lies on the line {x + y = k}, then at the end of the iteration, P\ will have advanced to a 
point on the line {x + y = k + m} where m is the size of the current block B. As P\ begins at the 
origin and as the sum of the block sizes is n — 1, the output path P\ indeed lies in Jz?Heis(^, ¥ g ). 
Since by construction the first step in P\ is not tT> in fact we have P\ G Jif}i e i S (n,W q ). 

Thus A i— >• P\ gives a well-defined map — > J2?Hcis(^ 5 F g ). Checking that this map is the inverse 
of P i— > Xp is straightforward from the definitions. To complete the proof of the theorem, we now 
must show that the characters £\ for A G X are the distinct Heisenberg characters of U n (F 9 ). By 
(jl.2p and Lemma 13.21 an irreducible character of U n (F g ) is Heisenberg if and only if it appears as 
a constituent of a supercharacter xa indexed by a labeled set partition A G II(n, ¥ q ) whose arcs 
are of the form + 1) or (i, i + 2). The set of such A corresponds via (II. ip to precisely the set 
of functionals y C X consisting of A G u n (F g )* with the following property: the upper form of the 
matrix of A is block diagonal with blocks of types (a) or (b). 

It suffices to show that if A G 3^ has block decomposition (Bi, . . . , Be), then the distinct irre- 
ducible constituents of x\ are t ne characters £„, where \x ranges over all functionals in X whose 
block decompositions are obtained from the block decomposition of A by the following operation: 
place an arbitrary (possibly zero) element of ¥ q in the upper left corner of each block Bi of type 
(b) with odd dimension (yielding a block of type (c) if the element is nonzero). 

If A = then xa = is irreducible and this statement holds trivially. Suppose the block 
decomposition of A has a single nonzero block. If the nonzero block has type (a) then x\ = £a is 
irreducible and the desired statement again holds trivially, and if the block has type (b) then the 
desired statement is simply Lemma 13.41 

To treat the general case, write A = Ai + A2 + ■ ■ ■ + \i where Aj G y in the unique functional 
with block decomposition 

(0, 0, 0, 0, . . . , 0, Bi, 0, 0, 0, 0, 0, ... , 0), where block Bj is mj x rrij. (4.2) 

v v y s v y 

miH \-mi—\ zeros m;+iH \-m,£ zeros 

Write Irr(x) for the set of irreducible constituents of a character x °f U n (F g ). It is enough to show 
two things: that if we have /Uj G u n (F g )* such that £ Mi G Irr(xAi) for each i G [£], then £^ G Irr(xA) 
for \x = fix + • • • + fif, and that every irreducible constituent of xx nas this form. To this end, we 
note that well-known properties of the supercharacters of U n (F g ) (see |28} Section 2.3]) imply that 
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Xx = Hi=i Xx, and (Xa>Xa) = I\i=i(xx i ,Xx l )- The result [22], Lemma 2.1] asserts that under these 
hypotheses the product map 

nLi Irr (XAj -> Irr(xA) ^ 

is a bijection. Since the elements of Irr(xAj and Lt(xa) are all characters of the form by 
Proposition if € u n (¥ q )* such that £ Mi G Irr(XAi) then J]Li £m» = ^ for some A 4 6 u n (F 9 )*. 
In light of the formula (|2.2h and the linear independence of the functions # v for v G u n (F g )*, we 
deduce that we can take fj, = fi\ + ■ ■ ■ + which completes our argument. □ 

The degree of the Heisenberg character £p has a simple formula in terms of P G Jzfneis^, F g ). 

Corollary 4.3. Let n be any positive integer and q > 1 any prime power. 

(1) The Heisenberg character £p indexed by P G J^Heis^, F g ) has degree £p(l) = q k+e , where 
k,£ are the numbers of times the steps /\tt respectively occur in P. 

(2) For integers n > 2 and e > 0, the number of Heisenberg characters of U n (F g ) with degree q e 
is 

«"- e - 2 ((""r 1 ) (9 - i)6+ (""r 2 )< 9 - i » e+i )' 

Remark. This result with Corollary 14.21 proves Theorem 11.21 in the introduction. The corollary 
also shows that the number of Heisenberg characters of U n (F (? ) with degree q e is a polynomial in 
q — 1 with nonnegative integer coefficients. The same statement for the irreducible characters of 
U n (F g ) is a conjecture usually attributed to Lehrer [18] ; it has been verified in the cases when 
either n < 13 [11] or e < 8 [22]. The number of Heisenberg characters of a pattern group can fail 
to be a polynomial in the size of the ambient field; see |12[ Theorem 4.9]. 

Proof. Fix P G J£}$ c \ s {n, ¥ q ) and let A = Ap G u n (F g )*. Suppose {B\, . . . ,B S ) is the block decom- 
position of A, where block i has size mi. Write A = Ai + • • • + \ s such that Aj G u n (F g )* has block 
decomposition (0, . . . , 0, Bi, 0, . . . , 0) as in (|4.2[) . and let Pi G J^ueisin, ¥ q ) be the unique path with 
Aj = A^ . 

For each i, the first mi + • • • + mj_i steps and the last m.j + i + • • • + rn s steps of the path Pi 
are all the horizontal step (1,0), and one can recover P by removing these steps from each Pi and 
concatenating the shortened paths which remain. It follows that the parameters k,£ defined for P 
are simply the sums of the respective parameters for the paths P\ , . . . , P s . Since we observed that 
£p = Y\t=i ^Pi m the proof of Theorem 14.1] it suffices to prove part (1) in the case when A has at 
most one nonzero block. Therefore, without loss of generality assume A = Aj for some i. 

Recall the matrix types (a), (b), (c) and the map A i— >■ P\ defined in the proof of Theorem 14.11 
If the unique nontrivial block Bi is of type (a), then A is invariant under the two-sided action of 
XJ n (F q ) and P uses only the steps — > and t, so k = £ = and £p(l) = 1 = q k+e - Suppose Bi is of 
type (b). If rrii is odd then we see from the definition of the map A h4 P\ that k = and £ = m ' 2 ~ 1 , 
and from Lemma 13.31 that the coadjoint orbit of A has size whence £ P (1) = q k+£ by $F2§. If 

mi is even then similarly k = 1 and I = m ' 2 ~ and the coadjoint orbit of A has size q mi by Lemma 
13.41 so again £p(l) = q k+i . Finally, if Bi is of type (c) then k = and £ = mi 2 -1 and by Lemma 
13.31 the coadjoint orbit of A has size g m ' _1 , so £p(l) = q k+i and we conclude that this holds for all 
PG^cis(n,F g ). 
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To prove part (2), observe that there are (f) (q — l) e+fc distinct Fg-labeled paths from the origin 
to the point (e — k, e + k) which use only the steps , and so there are (q — l) e q e distinct 
F g -labeled paths from the origin to the line x + y = 2e which use only the steps jf, /*. As there 
are (t n ~ 2e ~ 1 ) +e ~^q n -' 2e - 1 ways to insert n — 2e — 1 labeled steps of the form — »,t into such a path, 
we deduce that the number of paths in Jfu e i S (n, ¥ q ) with exactly e steps of the form jf , /* is 
{ n ~T 1 )(9 ~ l) e 9 n_e_1 , and that (™^ 2 )(g - l) e +V~ e ~ 2 of these begin with f. Subtracting the 
second of these quantities from the first gives the desired formula after applying the usual recurrence 
for binomial coefficients. □ 

If P G Jz?Heis(^> ¥ q ) then the Heisenberg character £p of U„(F 9 ) is a constituent of the super- 
character indexed by Ap S u n (F 9 )*. The character £p is equal to this supercharacter only if the 
latter is irreducible, and this occurs exactly what the left and right U„(F g )-orbits of Ap 6 u n (F g )* 
have a trivial intersection. It is straightforward to see from our definition of Ap that this fails if the 
path P uses the step tT = (0> 2). Thus £p is a Heisenberg supercharacter only if P G J£p e u(n,¥ q ) C 
^kcis(^)Fq). This necessary condition is in fact sufficient, since if P G Jz?p e u(n, F,j) then Ap is 
equal to the linear functional defined by the unique F g -labeled set partition Ap of [n] satisfying the 
following condition: 

Ap has an arc labeled by t G F* if and only if P has a step labeled by t which travels 
from the point (cc, y — 1) to the point (x' , y) such that i = x + y and j = x' + y + 1. 

It is routine to check that the correspondence Jz?p e ii(n, ¥ q ) — >• NC(n,F 9 ) given by P h-> Ap is well- 
defined, and that Ap = Ap as elements of u n (¥ q )*. Thus, if we write xp f° r the supercharacter 
indexed by Ap for P G =2p e u(n, ¥ q ), then xp = £p an d the following theorem is immediate. 

Theorem 4.2. The map 

-^Pcii(^)Fq) — > {Heisenberg supercharacters of U n (F g )} 
P ^ XP 

is a bijection, and the number of Heisenberg super characters of U n (F 9 ) is V n {q — 1). 

Remark. Thus, as mentioned in the introduction, the Pell numbers [261 A000129] count the 
Heisenberg supercharacters of U n (F2). It is also not difficult to show that the numbers of Heisen- 
berg supercharacters of U„(F 3 ) form the sequence {V n (2)}™ =0 = (0, 1, 3, 11, 39, 139, 495, . . . ) [26l 
A007482] whose nth term is the number of subsets of [2n] in which each odd number has an even 
neighbor. 

5 Counting invariant characters 

We now consider the Heisenberg characters of TJ n (¥ q ) which are invariant under the action by 
multiplication of the group's linear characters. By Lemma 13.21 there are q n ~ l linear characters of 
U n (F g ), and one easily confirms that they are precisely the functions 9 T : g \-} 6 o r(g — 1) defined 
in Section I2TT1 for r G F g -span{e* i+1 : 1 < i < n}. 

Proposition 5.1. A Heisenberg character of U n (F 9 ) is invariant under multiplication by all linear 
characters if and only if it is indexed by a labeled path in Jj?n e i S (n,¥ q ) which uses only the steps 
/* and "jf. There are q k ~ l (q — l) k such paths if n = 2k + 1 is odd and zero such paths if n is even. 
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Remark. More generally, one can check by some tedious calculations that the size of the linear 
character orbit of the Heisenberg character indexed by P € Jz?Heis(^> IF 9 ) is q k where k is the number 
of steps in P given by — > or t. 

Proof. The Heisenberg character indexed by P € J^YL C i s (n,F q ) is invariant under multiplication 
by all linear characters if and only if Ap and Ap + r belong to the same coadjoint orbit for all 
r £ F 9 -span{e| i+1 : 1 < i < n}. This follows because £p is the Kirillov function indexed by Ap, 
and so the formula (j2.2j) (with the fact that r is invariant under the two-sided action of the group) 
implies that the product of 9 T and £p is the Kirillov function indexed by Ap + r. 

Because Ap is a linear combination of functionals of the form e* i+1 and e* i+2 , it follows by 
inspection (if not from the preceding discussion) that every element of the coadjoint orbit of Ap 
has the form Ap + r for some r € F g -span{e* i+1 : 1 < i < n}. We deduce from this that £p is 
invariant if and only if the size of the coadjoint orbit of Ap is exactly c/ n_1 , or equivalently if £p 

n — l 

has degree q~^~ ■ The proposition is now an immediate consequence of Corollary 14.31 □ 

For n > 2, we define a : U n (F 9 ) -4- F+ as the homomorphism o~(g) = Y17=i 9i,i+i anc ^ ^ C 
denote the subgroup of linear characters ip of U n (F g ) which have ip(g) = 1 whenever o~(g) = 0. One 
checks that this coincides with the set 

C={i)o(rJe Horn (F+,C X )} 

given in the introduction. Noting our description of the linear characters of the unitriangular group, 
we also note that 

C = {6 tl : t € ¥ q } , where 7 = e lj2 + e^ 3 + • • • + e^ n _ x E u n {¥ q )*. 

As a preliminary matter let us describe the C-invariant supercharacters of U n (F 9 ). From the for- 
mula (|2.ip . it is clear that \\ is C-invariant if and only if the two-sided U n (Fq)-orbit of A € u n (Fq)* 
contains A + tj for all t € ¥ q . Using this fact, the following lemma is essentially a straightforward 
technical exercise in linear algebra. 

Lemma 5.1. The super character of U n (Fg) indexed by A € IL(n,¥ q ) is C-invariant if and only if 
for each j € [n — l], there exists either some (i, j + 1) G Arc(A) with i < j or some (j, k + 1) € Arc(A) 
with j < k. 

Remark. One could also prove this result by noting that the elements of C are themselves super- 
characters, and then applying either the formula [28} Eq. 2.1] or \28\ Corollary 4.7], which gives 
partial rules for decomposing products of supercharacters as sums of supercharacters. 

The matrix of a labeled set partition A G U(n,¥ q ) is the nxn matrix j)eArc(A) ^-ij e ij\ 
associating a set partition to its matrix gives a bijection from U(n,¥ q ) to the set of strictly upper 
triangular nxn matrices over ¥ q with at most one nonzero entry in each row and column. Shifting 
the matrix of a set partition one column to the right correspond to the injective map 

shift : n(n,F g ) -4 U(n + l,¥ q ) 

given by defining shift(A) to be the F g -labeled set partition of [n + 1] with arc set {(i, j + 1) : (i,j) € 
Arc(A)} and labeling map (i, j + 1) 1 — > Aij. If we ignore all labels, then shift is the left inverse of 
the "reduction algorithm" presented in [6]. 
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We say that a set partition is feasible if each of its blocks has at least two elements. We 
have appropriated this term from another context: in [3], Bernhart alternately refers to partitions 
of [n] whose blocks do not contain any of the sets {1, 2}, {2, 3}, . . . ,{n — l,n},{n, 1} as subsets 
as "cyclically spaced" or "feasible." Such partitions are in bijection with partitions of [n] whose 
blocks have at least two elements (see [U Section 3.5]), and so we decide to call partitions of the 
latter type "feasible" since these objects seem to lack a well-known name in the literature. 

Denote the number of feasible partition of [n] with k blocks by {[i!]f. These numbers are 
sometimes called the associated Stirling numbers of the second kind [8] and are listed as sequence 
\26\ A008299]. The number of feasible Fg-labeled set partition of [n] is then given by J- n {q — 1) 
where 



n— k 



The integer sequence {T n (l)}^ =0 = (1,0, 1, 1,4, 11,41, . . . ) counting the feasible partitions of [n] 
appears as [261 A000296]. 

Since a feasible set partition A h [n] has some (i,j) £ Arc(A) or some (j, k) € Arc(A) for each 
j £ [n — 1] , the following result is clear from Lemma 15.11 

Proposition 5.2. The correspondence A i— > XshifttA) is a bijection 

{Feasible elements of H(n,F q )} — > {C-invariant supercharacters of U n+ i(F ? )}. 

Hence U n +i(F g ) has J- n (q — 1) distinct C-invariant supercharacters. 

Recall the definitions of H(n,W g ) and NC(n,F g ) from the introduction. The cardinalities of 
these sets are given respectively by B n (q — 1) and Af n (q — 1), where 



B n {x) :=Y,\ n k \x n - k and M n (x) := ^ N(n, k) 

k=0 ^ ' k=0 



x n ~ k . 



Here {^} and N(n, k) are the Stirling numbers of the second kind and the Narayana numbers, 
defined as the number of ordinary and noncrossing set partitions of [n] with k blocks (equivalently, 
with n — k arcs). We note the well-known formula N(n, k) = ~Cu) (uli) f° r n > and adopt the 
convention {^} = N(0,k) = 5k- In explanation of our notation, B n {l) is the nth Bell number and 
N n {x) is the Narayana polynomial, whose values give the Catalan numbers when x = 1 and the 
little Schroder numbers when x = 2. 

Let C n = M n (l) = ( 2 ^) denote the nth Catalan number. The polynomials B n (x) and ftf n (x) 
have the noteworthy alternate formulas 

B n+1 (x) = ^( n k y k (x)(x + l) n - k and Af n+1 (x) = ]T C k I " J x k (x + l) n ~ 2k (5.1) 

k=0 ^ ' k=0 ^ ' 

for all n > [23^ Theorem 3.2]. The right hand side in particular is a well-known identity due to 
Coker [7], which will be of use in the following corollary. 

Corollary 5.1. Fix a nonnegative integer n and a prime power q > 1. 
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(1) The number of C-invariant irreducible super characters of U n +i(F 9 ) is 

(l-,)^^ +1 (-l) = (^- 1)n/2C "/ 2 ' ^ iS ™ ; 

10, if n is odd. 

(2) The number of C-invariant Heisenberg supercharacters of U n +i(F 9 ) is 

(l-g)^ B+1 (-l) = (( ff - 1)B/2 ' ^ iseven; 

10, if n is even. 

Proof. The equality of the expressions in (1) and (2) follows from ()5.ip and Proposition 14.11 As 
discussed in [3 [23], if A £ II(n— 1,F ? ) then shift (A) is noncrossing if and only if A is noncrossing and 
has no blocks with more than two elements. It follows from the preceding proposition that the C- 
invariant irreducible supercharacters of U n+ i(F g ) are in bijection with the F g -labeled noncrossing 
partitions of [n] whose blocks all have size two. Such partitions clearly exist only if n is even, 
in which case their number is equal to the given expression because the number of (unlabeled) 
noncrossing partitions of [2k] whose blocks all have size two is by [271 Exercise 6.19o]. 

For the second part, observe by Lemma 13.21 that the supercharacter Xshift(A) is Heisenberg if 
and only if shift(A) is noncrossing and has no arcs (i,j) with j > i + 2. Consulting the definition 
of shift, we see that this is equivalent to the condition that A be noncrossing with no blocks with 
more than two elements and no arcs (i,j) with j > i + 1. It follows that XsHft(k) is Heisenberg and 
C-invariant if and only if the unlabeled form of A is {{1, 2}, {3, 4}, . . . , {2k — 1, 2k}} for some k. 
Hence there are (q — l) k distinct C-invariant Heisenberg supercharacters of U n+ i(F,j) when n = 2k 
and no such supercharacters if n is odd. □ 

Let us now return our attention to Heisenberg characters. We do not know of a combinatorial 
bijection from the set of C-invariant Heisenberg characters of U n+ i(F g ) to the family of labeled 
lattice paths J>?i nv (n, F g ), but we can prove that these two sets are equinumerous. 

Theorem 5.1. The number of C-invariant Heisenberg characters of \J n ^i(¥ q ) is I n (q — 1). 

To show this, we first derive an explicit formula for the number of Heisenberg characters of 
U n+ i(Fg). In the following lemma, by a composition of a number n, we mean a sequence of 
positive integers whose sum is n. The positive integers are the parts of the composition. 

Lemma 5.2. For each composition c = (ci, . . . , q) of a positive integer n, define 

e 

/*(<0 = II ((« - 1 ) Cl_1 - M^/2)(q - l)^ 1 ^ 

i=l 

The number of C-invariant Heisenberg characters of U n +i(F g ) is then the sum ^2 c fq(c) over all 
compositions c of n. 

Proof. The sum in the lemma is if n = 1, which is the number of C-invariant Heisenberg characters 
of U2(F g ) since in that case C is equal to the set of all irreducible characters of U2(F g ) = F+. 

Assume n > 2 and let G = U n+ i(Fq) and n = u n+ i(F (? ). Choose A 6 n(n + l,F g ), and view 
this labeled set partition as a functional in n* in the usual way via (|l.ip . By Lemma 13. 2[ if tp 
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is a C-invariant Heisenberg constituent of xa> then xa 1S C-invariant and every G Arc(A) 

has j < i + 3 since kerA D n 3 . By Lemma 15.11 it follows that every C-invariant Heisenberg 
character of G is a constituent of a supercharacter xa f° r some A G n(n + l,F g ) which has 
Arc(A) C + 2) : i G [n — 1]} such that if + 2) ^ Arc(A) for some i G [n - 1], then both 
(i — 1, i + 1) and (i + 1, i + 3) belong to Arc(A). 

Recall the definition of the block decomposition of an element of n* given just after Theorem l4.H 
and define X as the set of A G n* with the property that each matrix B in the block decomposition 
of A is m x m with m > 2 and has By ^ if and only if j = i + 1. It is not difficult to see that our 
previous assertion is equivalent to the statement that every C-invariant Heisenberg character of G 
is a constituent of a supercharacter xa f° r a unique A G X. 

Fix A £ A 1 and let 7 = Y^=i e *j j+i e n *- ^he constituents of xa are the Heisenberg characters 
^ for fi G GAG and, as noted above, the elements of C are the functions 0f 7 for i G F 9 . As in 
the proof of Proposition 15.11 since ker7 D n 2 , the formula (|2.2p implies = £«+t7 and so the 

character for /i G GAG is C-invariant if and only if \x + F g -span{7} is a subset of the coadjoint 
orbit of //. By construction, the two-sided G-orbit of A is GAG = A + Fg-span{e* J+1 : j G [n]} 
and so [i — A is invariant under the two-sided action of G for each fi G GAG. Consequently, if 
/i G GAG then ji + F g -span{7} is a subset of the coadjoint orbit of [i if and only if A + F g -span{7} is 
a subset of the coadjoint orbit of A. Thus, if A + F 9 -span{7} is a subset of the coadjoint orbit of A 
then every irreducible constituent of xa is a C-invariant Heisenberg character, while no irreducible 
constituents of xa are C-invariant otherwise. 

Let (B\, . . . ,Bi) be the block decomposition of A, and let rrii > 2 be the dimension of block 
Bi. Note that each B{ has a nonzero entry in each superdiagonal position, and zeros in all of other 
positions. The sequence of positive numbers (mi, . . . , mg) is a composition of n; call this the shape 
of A G X. As in the proof of Theorem I4.1|. write A = Ai + • • • + \g where each Aj G n* is the unique 
functional with block decomposition (0, . . . , 0, Bi, 0, . . . , 0) as in (|4,2p . Fix i G [£]; then Aj has the 
form Aj = tje*j +2 + ■ ■ ■ + tke* k k+2 f° r some integers l<j<k<n — 1 with m, = k — j + 2 where 

tj,...,t k e¥*, and we define 7* G n* by ji = e* J+1 H h e^ fc+1 + e^, +life+2 . Then 7 = 71 H 

and a straightforward computation shows that A + F^-span^} is a subset of the coadjoint orbit 
of A if and only if A^ + Fg-span^j} is a subset of the coadjoint orbit of each A.;. By Lemmas 13.31 
and 13.41 the coadjoint orbit of Aj is formed by adding Aj to all elements in some subspace of n*. 
Hence, every irreducible constituent of xa is C-invariant if Aj + 7, belongs to the coadjoint orbit 
of Aj for each index i, and xa has no C-invariant irreducible constituents otherwise. In the latter 
case, the C-orbits of the irreducible constituents of xa all have order q, because C acts freely on 
these constituents since xa is C-invariant. 

Each Aj is determined by a choice of rrii — 1 entries tj, . . . G F^ . If is even, then part (1) of 
Lemma [3.41 asserts that Aj + 7, belongs to the coadjoint orbit of Aj for all (q — l) m ! _1 choices of these 
entries. If mi is odd, then part (2) of Lemma 13.41 gives a formula the number of choices of entries 
which result in Aj + 7» belonging to the coadjoint orbit of \. From these lemmas, we conclude 
that the number of functionals A G X with a fixed shape (mi, . . . ,m^), for which all irreducible 
constituents of xa are C-invariant, is the product Y\i=i fq( m i)i where 

~ — l) m_1 , if m is even; 

Mm) = ji (( g _ i)m- 1 _ (_i)(— D/2( ? _ !)(m-i)/2) if m is odd _ 

By Lemma 13.41 the number of irreducible constituents of the supercharacter XA; is one if rrii 
is even and q if mi is odd. Thus, by \22\ Lemma 2.1] (see Eq. (|4.3p above), the number of 
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irreducible constituents of xx depends only on the shape m = (mi, . . . , mi) and is gl{* e M :m ! 1S ° dd }l. 
The product of this quantity with Y\i=i fq( m i) i s exactly f q (m), and we conclude that f q (m) is 
the number of C-invariant Heisenberg characters which appear as constituents of super characters 
indexed by functionals in X with the shape m. The sum of f q (m) over all shapes m of elements 
of X is thus equal to the number of C-invariant Heisenberg characters of U n +i(F 9 ). These shapes 
range over all compositions of n whose parts are all at least two. Since / 9 (m) = if m has any 
parts less than two, the proof is complete. □ 

The following observation is implicit in the arguments in this proof. 

Observation 5.1. The C-orbit of a Heisenberg character or super character of U n (F g ) has size 1 
or q. 

Proof. It is an easy exercise to deduce from the supercharacter formula |28} Eq. 2.1] that the 
C-orbit of a supercharacter has size 1 or q. We noted at the end of the fifth paragraph of the 
preceding proof that if a Heisenberg character is a constituent a C-invariant supercharacter, then 
its C-orbit has size 1 or q. If a Heisenberg character is a constituent of a supercharacter which is 
not C-invariant, then the C-orbit of the Heisenberg character has size q since each character in the 
orbit is a constituent of a distinct supercharacter. □ 

Returning to the proof of Theorem 15-H we note that one can deduce from the generating 
function of T n (x) that 



l n (x) 



0, ifn=l; 

x, if n = 2; 

x{x + 1), if n = 3; 

xl n -i(x) + x(x + l)I„_ 3 (x), if n > 4. 

We now demonstrate that the formula in Lemma 15.21 also satisfies this recurrence. 



(5.2) 



Proof of Theorem \5.1[ Fix q and write a n for the number of C-invariant Heisenberg characters of 
U n+ i(F 9 ). We compute from Lemma [5T2l that a n = T n (q—1) for n = 1, 2, 3, so to show a n = I n (q—1) 
for all n > 1, it suffices to prove a n = (q — l)a n -i + q(q — l)an-3 for n > 4. To this end, observe 
that the formula in Lemma 15.21 implies 

n 

((« - i)*" 1 - sin(W2)(<7 - l)**" 1 )/ 2 ) a n _ k , for n > 2. (5.3) 



a n = 

k=2 

In particular, each term in this sum corresponds to the sum ^ c f q (c) over all compositions c of 
n whose parts are all at least two and whose last part is k. Fix n > 4. Applying (|5.3p to a n and 
a„_i, we obtain 

n-l 

a n 

k=2 

Expanding the a n _2 term on the right hand side via a second application of (|5.3p . this equation 
becomes 

n-l 



(q - l)a n _i = (q- l)a„_ 2 + £ (sin(fc7r/2)(g - l)^ 1 )/ 2 - cos(£;7r/2)(<Z - l) fc / 2 j a n _i_ fe . 



a n - (<? - l)a n _i = fa - 1K_ 3 + l) fc_1 + sin(fc7r/2)(<? - l)( fe+1 )/ 2 ) a n _i_ fc . 



fc=4 
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Shifting indices and comparing with (|5.3p shows that the sum on the right hand side is (q — l) 2 a n _3; 
notably, when n = 4 and the sum is zero, this still holds because a\ = 0. Thus, a n = (q — l)a n ,„i + 
q(q — l)a n _3 for n > 4 as required. □ 



6 Applications to the alternating subgroup of U n (F g ) 

Fix n > 2 and recall that a : U n (F g ) — > F+ is the homomorphism g i-> Y17=i 9h i + 1 - When 
q = 2, composing this map with the nontrivial homomorphism 9 : F2 — > C x yields the unique 
homomorphism U n (F2) — > C x which assigns —1 to each of the n — 1 generators 1 + e^j+i. In 
this sense, a serves as something of a unitriangular analogue for the sign homomorphism of the 
symmetric group, and we therefore refer to the kernel of a, i.e., the algebra group 

U£(F g ) := j 5 € U„(F 9 ) : X> M +i = °| > for » > 2 > 

as the alternating subgroup of U n (F g ). We discussed this algebra group briefly in Example 5.1 in 
[19j . which computed a formula for the number of its supercharacters. Here, using the results of the 
previous section, we give a more comprehensive set of formulas, counting in addition the numbers 
of irreducible supercharacters, Heisenberg supercharacters, and Heisenberg characters. 

To derive these formulas we require the following lemma, a straightforward exercise in the 
Clifford theory. 

Lemma 6.1. Fix an integer n > 2 and a prime power q > 1. The following statements hold for 
supercharacters: 

(a) Each supercharacter of U n (F 9 ) restricts to a supercharacter of U^(F 9 ), and every superchar- 
acter of U^(F 9 ) arises in this way. 

(b) Two supercharacters of TJ n (F q ) have the same restriction to U^(F g ) if and only if they belong 
to the same C-orbit. 

(c) A supercharacter % of XJ n (F q ) restricts to an irreducible character of U^(F g ) if and only if x 
is irreducible and not C-invariant. 

Likewise, the following statements hold for Heisenberg characters: 

(d) A Heisenberg character ip of U n (F g ) restricts to a sum of q distinct Heisenberg characters of 
U^(Fq) if tp is C-invariant, and to a single Heisenberg character of U^(F g ) otherwise. 

(e) Every Heisenberg character of U^(F g ) appears as an irreducible constituent of the restriction 
of a Heisenberg character of U re (F 9 ). 

(f) The restrictions to U^(F 9 ) of two Heisenberg characters ip,ip' of U n (F g ) are equal if i/j and 
?// belong to the same C-orbit, and they share no irreducible constituents otherwise. 

Proof. Let C = U n (F q ) and H = U£(F ff ), and note that |C| = \G\/\H\ = q since n > 2. Problem 
(6.2) in [13] asserts that if tp is an irreducible character of H then Ind^(V ; ) = / Y2t=i Xi where / is 
an integer and the \i comprise a C-orbit of irreducible characters of G. This fact with Frobenius 
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reciprocity suffices to prove (f). For any i, we have qip(l) = /sxi(l) and / = (tp, Res^(xi))-ff by 
Frobenius reciprocity. Thus ip = Res^(xi) if and only if / = 1 and s = q, and we conclude that an 
irreducible character x of C restricts to an irreducible character of H if and only if the C-orbit of 
X has size q. 

Example 5.1 in [19] derives (a) and (b) from [191 Lemma 5.1]. Certainly only an irreducible 
supercharacter of G can restrict to an irreducible supercharacter x of H, and it follows from the 
previous paragraph and Corollary 15.11 that if x is irreducible then this occurs if and only if x is not 
C-invariant. This proves (c). 

Part (e) is immediate from the fact that [G, [G,G]] = [H, [H, H]] = 1 + (u n (F g )) 3 , the proof of 
which we leave as an exercise. To prove (d), let x be a Heisenberg character of G. By Clifford's 
theorem |13| Theorem (6.2)], the restriction of x to H has the form Res^r(x) = e X/i=iV , i f° r a 
positive integer e and t distinct Heisenberg characters ipi of H with the same degree. If x is C- 
invariant, then x(d) = for all g G G - H so 1 = (x,X)G = j§|(Resg (x), Resf (x))h = e 2 t/q 
and e 2 t = q. On the other hand, x(l) = e ^i(l) an d both x(l) and are powers of q by [14^ 

Theorem A]. Hence e and t are both powers of q; since these numbers are integers with e 2 t = q, 
we must have e = 1 and t = q. Thus a C-invariant Heisenberg character of G restricts to a sum of 
q distinct Heisenberg characters of H . If x is not C-invariant then by Observation 15.11 the C-orbit 
of x has order q, and it follows as in the supercharacter case that x restricts to an irreducible 
character of H. □ 

We are now prepared to list the character counting formulas promised for U^(F g ). For each 
positive integer n, define the following rational functions in an indeterminate x: 



E£+i(x) := ^B n+1 (x)- F n {xj) +F n (x); 

K+lW ■■= iTT^n+l^) " (-x)L»/ 2 JJW-1)); 
K + X^) ■= 5Tt(^+i(^) - (-x)^V n+1 (-l)); 

K+l(x) : = iTT (Un+lix) ~ Zn(x)) +(X + l)X n { X ). 



x+l 

It is immediate from Lemma 16.11 combined with Proposition 15. 2\ Corollary 15. 1\ and Theorem 15.11 
that B°(q— 1), J\f£(q—1), V%(q—1), and H^q—l) respectively count the supercharacters, irreducible 
supercharacters, Heisenberg supercharacters, and Heisenberg characters of the alternating subgroup 
U^(F 9 ). To see that these rational functions are actually polynomials in x with nonnegative integer 
coefficients, we first note from Eq. (|5.ip and Proposition 14. II that 



k=0 ^ ' 
L(n-1)/2J 

l — n V / 



A;=0 
L(n-1)/2J 
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The function Hn+l( x ) ^ s likewise a polynomial with nonnegative coefficients since by Corollary 
14.11 %2 ( x ) = 1 an< i T^3( x ) = (x + l) 2 and for n > 4, both T-L n+ i{x) and T n {x) are divisible by 
x + 1. These observation provide us with the following result, which implies Theorem 11.31 in the 
introduction. 

Theorem 6.1. The polynomials B°(x), Af^ix), V°{x), and Hn( x ) have nonnegative integer coef- 
ficients, and their values at x = q — 1 are respectively the numbers of supercharacters, irreducible 
supercharacters, Heisenberg supercharacters, and Heisenberg characters of the alternating subgroup 
U°(F q ) C U n (F,) for n > 2. 

Remarks. Some remarks are in order. 

(i) Proposition 5.2 in [19] gives the alternate formula 

Bn +1 (x) ^k) Bn ~ k ^ 11 ~ L 

Noting the well-known recurrence B n+ \{x) = J2k x k (^)B n -k{x) [HI [Ml EQ] , one finds that the 
sequences of differences {B°(l) - 8 n _i(l)}£L 2 = (0, 1, 3, 13, 55, 256, 1274, . . . ) [261 A102287] 
and {B n (l) - ££(1)}£° =2 = (1,2,7,24,96,418,1989,...) [26l A102286] give respectively the 
numbers of distinguished even and odd blocks in all set partitions of [n — 1]. By distinguished, 
we mean that we consider two blocks to be equal if and only if they are equal as sets and 
belong to the same set partition. For example, the set partitions of {1,2,3} (in abbreviated 
notation) are 1|2|3, 12 1 3, 13 1 2, 1 1 23, and 123, and they contain 10 distinguished blocks, of 
which 3 are even and 7 are odd. 

(ii) If C(z) is the ordinary generating function for C n = M n (l) and D(z) = 1 — 2z + zC(z 2 ) then 
one finds that ^ (C(z) — D{z)) = E n >2-C(l) 2 "' Comparing this to the generating function 
listed for sequence A000150 in [26], we find that {A^(l)}£° =2 = (1,2,7,20,66,212,715,...) 
gives the number of Dyck paths with 2n steps having an odd number of peaks at even height. 
These numbers also count the number of dissections of an n-gon, rooted at an exterior edge, 
which are asymmetric with respect to that edge. 

(iii) The integers {P£(1)}£L = (°. ^ 2 ' 6 > 14 ' 35 ' 84, ... ) appear as sequence A105635 in [26], which 
identifies these numbers as the row sums of two related integer arrays. 

(iv) A polynomial f(x) of degree n is palindromic if f(x) = x n f(x~ 1 ), so that its coefficients 
are the same read forwards and backwards. It follows from (|5.ip . Proposition 14.11 and the 
formulas above that the polynomials M n (x), V n (x), A/"^(x), and V%(x) are all palindromic. 
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